Out of equilibrium functional central limit theorems for a large 
network where customers join the shortest of several queues 
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Abstract. Customers arrive at rate Na on a network of N single server infinite buffer queues, 
choose L queues uniformly, join the shortest one, and are served there in turn at rate (3. We let 
N go to infinity. We prove a functional central Umit theorem (CLT) for the tails of the empirical 
measures of the queue occupations, in a Hilbert space with the weak topology, with limit given 
by an Ornstein-Uhlenbeck process. The a priori assumption is that the initial data converge. 
This completes a recent functional CLT in equilibrium in Graham Q for which convergence for 
the initial data was not known a priori, but was deduced a posteriori from the functional CLT. 

Key-words and phrases. Mean-field interaction, non-equilibrium fluctuations, inhomogeneous 
Ornstein-Uhlenbeck process in Hilbert space, infinite-dimensional analysis. 
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1 Introduction 

1.1 The queuing model 

We continue the asymptotic study for large N and fixed L initiated in Vvedenskaya et al. [9| of a 
Markovian network constituted of single server infinite buffer queues. Customers arrive at rate 
Na, are allocated L distinct queues uniformly at random, and join the shortest, ties being resolved 
uniformly at random. Service is at rate (3. Arrivals, allocations and services are independent. The 
interaction structure depends on sampling from the empirical measure of L-tuples of queue states; in 
statistical mechanics terminology, this constitutes L-body mean-field interaction. 

Let Xf{t) be the length of queue i at time t > 0. The process (A'j^)i<j<Ar is Markov, its em- 
pirical measure /^^ = Yld=i <^x^ has samples in 'P(D(M_|_, N)), and its marginal process (/i{^)t>o 
has sample paths in D(R+, 'P(N)). We are interested in the tails of the marginals, and consider 



V = {{v{k))km ■■ v{0) = 1, vik) > v{k + 1), lim^; = 0} , = V n ^N^ , 
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with the uniform topology (which coincides here with the product topology) and the process R = 
{R^)t>o with sample paths in D(]R+, V^) given by 

1 ^ 

i=l 

The processes {ij^)t>o and {R^)t>o are in relation through p G V(N) < — > t; G V for v{k) = 
p[k, oo) and p{k} = v{k) — v{k + 1) for k in N. This classical homeomorphism maps the subspace 
of probability measures with finite first moment onto V H £i, corresponding to a finite number of 
customers in the network. The symmetry structure implies that these processes are Markov. 

1.2 Laws of large numbers 

Let Cg and £p for p > 1 denote the subspaces of sequences vanishing at of the classical sequence 
spaces Co (with limit 0) and £p (with summable absolute p-th power). We define mappings with 
values in cj] given for v in cq by 

F+{v){k) = a{v{k - l)^ - v{k)^) , F^{v){k) = (3{v{k) - v{k + 1)) , k>l, (1.1) 

and F = — F_, and the nonlinear differential equation ii = F{u) on V, explicitly for t > 

iit{k) = F{ut){k) = a{ut{k - 1)^ - ut{k)^) - P{ut{k) - utik + 1)) , k>l. (1.2) 

This corresponds to (1.6) in Vvedenskaya et al. O (with arrival rate A and service rate 1) and 
(3.9) in Graham \2\ (with arrival rate u and service rate A). Theorem 1 (a) in |9| and Theorem 3.3 
in yield that there exists a unique solution u = {ut)t>o taking values in V for (ll.2t . which is 
continuous, and if uq is in V n £i then u takes values in V H ^i. 

A functional law of large numbers (LLN) for converging initial data follows from Theorem 2 in 
l9l . We give below a result contained in Theorem 3.4 in 0. 

Theorem 1.1 Let {R^ 

)n>l converge in probability to uq in V. Then {R )n>l converges in prob- 
ability in B(M-|-, V) to the unique solution u = (ut)t>o starting at u^for M.2\ . 

The networks are stable for /) = < 1. Then Theorem 1 (b) in Vvedenskaya et al. f9l| yields 
that (11.21) has a globally stable point u in V H £i given by u{k) = piL''-i)/{L-i)_ A functional LLN 
in equilibrium for {R^)n>l with limit u follows by a compactness-uniqueness method validating 
the inversion of limits for large sizes and large times, see Theorem 5 in (9| and Theorem 4.4 in |2]|. 

The results of |9|| are extended in Graham Q, in particular to LLNs and propagation of chaos 
results on path space. Theorem 3.5 in IS gives convergence bounds in variation norm for the chaotic- 
ity result on [0,T] for (Xj^)i<j<Ar for (X/^(0))i<j<Ar i.i.d. of law q, using results in Graham and 
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Meleard EJ. These bounds can be somewhat extended for initial data satisfying appropriate a priori 
controls, but behave exponentially badly for large T. 

1.3 Central limit theorems 

Graham |l3l and the present paper seek asymptotically tight rates of convergence and confidence 
intervals, and study the fluctuations around the LLN limits. For Rq in and uq in V we consider 
the process i?^, the solution u for (I1.2I) . and the process = {Z^)t>o with values in Cq given by 

Z^ = Vn{R^ - u) . (1.3) 

Graham focuses on the stationary regime for a < /3 defining the initial data implicitly: the 
law of Rq is the invariant law for R^ and uq = u. The main result in ||3| is Theorem 2.12, a 
functional central limit theorem (CLT) in equilibrium for {Z^) n>l with limit a stationary Ornstein- 
Uhlenbeck process. This implies a CLT under the invariant laws for {Zq )]\[> l with limit the invariant 
law for this Gaussian process, an important result which seems very difficult to obtain directly. The 
proofs actually involve appropriate transient regimes, ergodicity, and fine studies of the long-time 
behaviors, in particular a global exponential stability result for the nonlinear dynamical system (II. 2t 
using intricate comparisons with linear equations and their spectral theory. 

We complete here the study in (3| and derive a functional CLT in relation to Theorem 11.11 for 
the Skorokhod topology on Hilbert spaces with the weak topology, for a wide class of Rq and uo 
under the assumption that {Zq)n>l converges in law (for instance satisfies a CLT). This covers 
without constraints on a and (3 many transient regimes with explicit initial conditions, such as i.i.d. 
queues with common law appropriately converging as N grows. Section |2l introduces in turn the 
main notions and results, and Section |3] leads progressively to the proof of the functional CLT by a 
compactness-uniqueness method. 

2 The functional central limit theorem 

For a sequence w = {w{k))f^>i such that w{k) > we define the Hilbert spaces 

L2H = |x G : x(0) =0, =J2f^\\^k) =J2^{k)Mkr' < ooj 

fe>i^ ^ '^^ fc>i ^ 

of which the elements are considered as measures identified with their densities with respect to the 

reference measure w. Then Li{w) = l\ and if w is summable then ||x||i < ||a^||L2(««) ^'^^ 

L2{w) C For bounded w we have the Gelfand triplet L2{w) C £2 L2{w)* = L2{'w^^). 
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Also, L2{w) is an I2 space with weights, and we consider the li space with same weights 

= 1 X G : x(0) = , = ^ \x{k)\w{k)-^ < 00 I . 

k>i ^ 

Clearly x E L2{w) <^ x"^ ^ ^liw). The operator norm of the inclusion V H £i{w) ^ V H L2{w) is 
bounded by 1 since = < for ||x||oo < 1. 

In the sequel we assume that w = {wk)k>i satisfies the condition that 

3c,d>0 : cw{k + l) <w{k) < dw{k + 1) for k > 1. (2.1) 

This holds for > for the geometric sequence {0^)k>i, yielding quite strong norms for 9 < I. 

Theorem 2.1 Let w satisfy 112. li . Then in V the mappings F, and F_ are Lipschitzfor the L2 (w) 
and the £i{w) norms. Existence and uniqueness holds for A1.2i in V H L2{w) and in V H ii{w). 

Proof. We give the proof for ii{w), the proof for L2{w) being similar (see Theorem 2.2 in Gra- 
ham El). The identity x^ - = {x - y){x^~^ + x^^^y H h y^"^) yields 

\u{k - 1)^ - v{k - w{k)-^ < \u{k - 1) - v{k - 1)| Ldw{k - 1)"^ , 
\u{k)^ - v{k)^\w{k)-'^ < \u{k) - v(k)\ Lw{k)-^ , 
\u{k + 1) - v{k + 1)1 w{ky^ < \u{k + 1) - v{k + 1)| c-^w{k + 1)~^ , 

hence \\F+{u) - F+{v)\\i,^(^^) < aL{d + l)\\u - v\\i^^y,) and ||F_(n) - F^{v)\U^^^) < (3{c-^ + 
l)\\u — v\\£^(^yjy Existence and uniqueness follows using a Cauchy-Lipschitz method. □ 

The linearization of (ll.2t around a particular solution n in I/' is the linearization of the equation 
satisfied by z = g — u where 5 is a generic solution for (II. 2t in V, and is given for t > by 

zt = 'K{ut)zt (2.2) 

where for t> in V the linear operator K(z;) : x \—>- K.{v)x on Cg is given by 

K{v)x{k) = aLv{k - l)^-^x{k - 1) - {aLv{k)^-^ + (i)x{k) + (5x{k + 1) , A; > 1 . (2.3) 

The infinite matrix in the canonical basis (0, 1, 0, . . .), (0, 0, 1, . . .), . . . is given by 



j - {aLv{l)^-^ + (5) (3 --A 

aLv{2)^-^ - {aLv{3)^-^ + p) ■■■ 

aLv{3)^-^ 

\ '■■ '■ '■■ "•■/ 
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and K.{v) is the adjoint of the the infinitesimal generator of a sub-Markovian birth and death process. 
The spectral representation of Karlin and McGregor [Tj was a key tool in Graham 01. but here it 
varies in time and introduces no true simplification. 

Let {M{k))k^f,] be independent real continuous centered Gaussian martingales, determined in 
law by their deterministic Doob-Meyer brackets given for t > by 

{M{k))t = f {F+{us){k) + F_{us){k)}ds . (2.4) 
Jo 

The processes M — (^M{k))k>o ^^id i-^) ~ ((-^(^)))fceN have values in Cq. 

Theorem 2.2 Let w satisfy ( 12. il l and uq be in V H £i {w). Then the Gaussian martingale M is 
square-integrable in L2{w). 

Proof. We have E(||Mt|||^(^^) = B{\\{M)t\\e^^^)) and we conclude using ^3, Theorem O and 
uniform bounds in £i{w) on (us)o<s<t in function of uq given by the Gronwall Lemma. □ 

The limit Omstein-Uhlenbeck equation for the fluctuations is the inhomogeneous affine SDE 
given for t > by 

Zt = Zo+ [ K{us)Zs ds + Mt (2.5) 
Jo 

which is a perturbation of ( I2.2t . A well-defined solution is called an Ornstein-Uhlenbeck process. 

In equilibrium u = u and setting K. = K(tt) and using dO and F+(n) = yields 
the simpler and more explicit formulation in Section 2.2 in Graham |3|. We recall that strong (or 
pathwise) uniqueness implies weak uniqueness, and that£i(ty) C L2{w). 

Theorem 2.3 Let the sequence w satisfy ( 12.71 1. 

(a) For V in V, the operator K(t>) is bounded in L2{w), and its operator norm is uniformly bounded. 

(b) Let Uo be in V Ci L2{w). Then in L2{w) there is a unique solution zt = e^o ^^^^^ '^^ zq for ( 12. 2 1 
and strong uniqueness of solutions holds for ( 12.51 1. 

(c) Let Uo be in V H li{w). Then in L2{w) there is a unique strong solution Zt = e-fo ^(^')'^^Zq + 
/g*e/.*KK)<ir^M,/orD W/fE(||Zo|||^(^)) < oo then E(supt<T < ^- 

Proof. Considering (I2.3t . v < 1, convexity bounds, and ( I2.lt . we have 

||K(v)x||i^(^) < 2(qL + P)Y^ {aLx{k - lfdw{k - 1)"^ + {aL + /3)x{kfw{k)-^ 

k>l 

+ (3x{k + l)^c-^w{k + 1)-^) 
< 2{aL + (3)iaLid + 1) + (3{c-' + 
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and (a) and (b) follow, the Gronwall Lemma yielding uniqueness. Under the assumption on no in (c) 
the maitingale M is square-integrable in L2{w). If E^||Zo||^^^^^^ < oo then the formula for Z is 
well-defined, solves the SDE, and the Gronwall Lemma yields E^supj<2- ll'^* Ili2(«>)) ^ ^^^^ 
any e > we can find < oo such that P(||;Zo||/,2{ui) — '^e) ^1 — ^> wA a localization procedure 
using pathwise uniqueness yields existence. □ 

Our main result is the following functional CLT. We refer to Jakubowski |[5l for the Skorokhod 
topology for non-metrizable topologies. For the weak topology of a reflexive Banach space, the 
relatively compact sets are the bounded sets for the norm, see Rudin [8 1 Theorems 1.15 (b), 3.18, and 
4.3. Hence, B{r) denoting the closed ball centered at of radius r, a set T of probability measures 
is tight if and only if for all e > there exists < oo such that p{B{r^)) > 1 — e uniformly for p 
in T, which is the case if T is finite. 

Theorem 2.4 Let w satisfy 112. li . Consider L2{w) with its weak topology and D(M+, L2{w)) with 
the corresponding Skorokhod topology. Let uq be in V H ^i{w) and Rq be in V^. Consider 
given by iLSl . If {Zq)j\[>l converges in law to Zq in L2{w) and is tight, then {Z'^)n>l converges 
in law to the unique Ornstein-Uhlenbeck process solving ( 12.51 1 starting at Zq and is tight. 



3 The proof 

Let {x)k = x{x — 1) • • • (x — A; + 1) for X G M (the falling factorial of degree k £ N). Let the 
mappings Fj^ and and with values in Cq be given for v in cq by 

F,^.)(.)=a (^-(^-^)]^-(^-(^))^ k>l, F» = F-(.)-F(.), (3.1) 

where F_ is given in (ll.lt . The process i?^ is Markov on V^, and when in state r has jumps in its 
A;-th coordinate, A; > 1, of size 1/iV at rate NF^{r){k) and size —1/N at rate NF^{r)(k). 

Lemma 3.1 Let Rq be in V^, u solve ( li.2l) starting at uq in V, and Z^ be given by \L3\i . Then 

Z^ = Z^ + f ^ {F^{R^)-F{us))ds + Ml^ (3.2) 

JO 

defines an independent family of square-integrable martingales = {M^ {k))k£fi independent 
of Zq with Doob-Meyer brackets given by 

(M^(fc)>^= f {F^iR^){k)+F_{Rf){k)}ds. (3.3) 
Jo 

Proof. This follows from a classical application of the Dynkin formula. □ 

The first lemma below shows that it is indifferent to choose the L queues with or without replace- 
ment at this level of precision, the second one is a linearization formula. 



Lemma 3.2 For N > L > 1 and a in M we have 
and {a) = N~^0{a) uniformly for a in [0, 1]. 

Proof. We develop = Y[l~^ = nf="o^ {a + {a- to obtain the identity for 

{a) and we deduce easily from it that it is N~^0{a) uniformly for a in [0, 1]. □ 



Lemma 3.3 For L > 1 and a and h in R we have 



B{a, h) := (a + h)^ - - La^-^h = ^ (^^^ a^-'W 



i=2 

,2 



with B{a, h) = Ofor L = 1 and B{a, h) = for L = 2. For L > 2 we have < B{a, h) < 
+ {2^ - L- 2) ah'^for a and a + hin [0, 1]. 

Proof. The identity is Newton's binomial formula. A convexity argument yields B{a, h) > 0. For a 
anda + h in [0, 1] and L > 2, B{a, h)<h^ + {^)ah^ = + {2^ - L - 2) ah'^ . □ 

For u in V and x in Cq, considering (ll.lt . (13.11) and Lemma IT2l let : V — > Cg be given by 

{v){k) = aA^ [v{k - I)) - aA^ {v{k)) , k>l, (3.4) 

and considering dl.ll) . (12.31) and Lemma l33] let : V x cj] ^ Cg be given by 

H{v,x){k)=aB{v{k-l),x{k-l))-aB{v{k),x{k)), k>l (3.5) 

so that for + X in V 

F^ = F + G^, F{v + x)-F{v) = K{v)x + H{v,x), (3.6) 

and we derive the limit equation (12.51) and (I2.4t for the fluctuations from (I3.2t and (13.31) . 

Lemma 3.4 Let w satisfy (12.71 1. Let uq be in V n £i{w) and Rq be in V^. For T > Owe have 
lim sup E I 1 1 ZJ^ 1 1 r / A I < cxD ^ lim sup E ( sup 1 1 Zj^ \\1 , ^ | < oo . 

Proof. Using and 

Zf = Z^ + Ml^ + ^/N f G^{R^) ds+ fVN ) - F(u,)) ds (3.7) 

Jo Jo 

where LemmalTland dO yield that G^{R^){k) = N-^0{R^{k - 1) + Rf{k)) and 

l|G"^(^f)IL.(.)=^'^0(||i?f||,^(^)). (3.8) 
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We have 



Theorem 12 . 1 1 yields that F+, F_ and F are Lipschitz, the Gronwall Lemma that for some Kt < oo 

sup \\Z.^\\, , ,<Kt( \\Z^\\, , , + N-'^''^KT\\uo\\r (. + sup ||M,^|L , J, 
and we conclude using the Doob inequality, (I3.3t . (I3.6t . 

ll^+«) + ^-«)IL,(^) < ll^f IL,(.) , (3-10) 

and the bounds (|3Jll and (IIS. □ 

Lemma 3.5 Let w satisfy iZ.li . and consider L2{w) with its weak topology and B(R-(_, L2{w)) with 
the corresponding Skorokhod topology. Let uq be in V H ^i{w) and Rq be in V^. Consider 
given by HL3\l . If {Zq)n>l is tight then {Z^)n>l is tight and its limit points are continuous. 

Proof. For e > let < oo be such that 'P{Zq G B{r^)) > 1 — e for N > 1 (see the discussion 
prior to Theorem l2.4t . Let R^''^ be equal to Rq on {Zq G i?(re)} and such that Z^'^ is uniformly 
bounded in L2{w) on {Zq B{ri;)} (for instance deterministically equal to some outcome of Rq 
on {Zq G B{ri;)}). Then Z^'"^ is uniformly bounded in L2{w) and we may use a coupling argument 
to construct Z^'^ and Z'^ coinciding on {Zq G i?(re)}. 

Hence to prove tightness of {Z'^)n>l we may restrict our attention to {Zq)n>l uniformly 
bounded in L2{w), for which we may use Lemma l34l 

The compact subsets of L2{w) are Polish, a fact yielding tightness criteria. We deduce from 
Theorems 4.6 and 3.1 in Jakubowski 1*51, which considers completely regular Hausdorff spaces (Ty- 
chonoff spaces) of which L2{w) with its weak topology is an example, that {Z^) Ar> ^ is tight if 

1. For each T > and e > there is a bounded subset Kt^e of L2{w) such that for > L we 
haveP(Z^ G D([0, T], Kt,^)) >l-e. 

2. For each d > 1, the d-dimensional processes (Z^(l), . . . , Z^ {d))N>L are tight. 

Lemma l3!4l and the Markov inequality yield condition 1. We use (13. 7t (derived from (13.2^ ) and 
(13. 3t and (13. 6t . and the bounds (13. 8t . (13. 9t and (I3.10t . The uniform bounds in Lemma llH and the fact 
that Z^{k) has jumps of size classically imply that the above finite-dimensional processes 

are tight and have continuous limit points, see for instance Ethier-Kurtz f\\ Theorem 4. 1 p. 354 or 
Joffe-Metivier |6| Proposition 3.2.3 and their proofs. □ 
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End of the proof of Theorem \2.4\ Lemma 13.51 implies that from any subsequence of we 
may extract a further subsequence which converges to some Z°° with continuous sample paths. 
Necessarily has same law as Zq. In (13.71) we have considering (13. 6t 

^{F{R^){k) - F{us){k)) = K(n,)Zf + VnH{us, N-^'^Z^) . (3.11) 

We use the bounds (13. 8I) . (13. 9t and (I3.10t . the uniform bounds in Lemma l3!4l and additionally (13. 5t 
and Lemma l33l We deduce by a martingale characterization that has the law of the Ornstein- 
Uhlenbeck process unique solution for (12.51) in L2{w) starting at Zq°, see Theorem 12. 3 1 the drift 
vector is given by the limit for (I3.2t and (I3.7t considering (13. lit , and the martingale bracket by the 
limit for (13. 3t . See for instance Ethier-Kurtz (U Theorem 4. 1 p. 354 or Joffe-Metivier K6l Theorem 
3.3.1 and their proofs for details. Thus, this law is the unique accumulation point for the relatively 
compact sequence of laws of {Z^) n>i, which must then converge to it, proving Theorem l2.4l 
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